CRITICISMS OF THE EPIDEMIOLOGIC STUDIES ON ETS AND LUNG CANCER 


Some general criticisms are applicable to the majority 
of the epidemiologic studies on ETS and lung cancer. 

Strength of the association 

• Wynder and Rabat wrote in 1990: 

An association is generally considered weak if 
the odds ratio is under 3.0 and particularly 
when it is under 2.0, as is the case in the 
relationship of ETS and lung cancer. 

Such a weak association calls for special attention to possible 

sources of bias and confounding. 

Exposure bias 

• Spouses, next-of-kin or friends are sometimes asked to estimate 

the amount of ETS to which they think the subject was exposed. 

This may result in something called "exposure bias" or 

2 

"exposure misclassification." 

• Exposure indices and risk estimates based on this type of 
information may be improper and incorrect. 

• One example of this was reported in the Garfinkel, et al., 
study, published in 1985, which reported relative risks of 
0.83 when the cases answered questions about ETS, 0.77 when 
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the cases' husbands answered, and 3.57 when the cases' children 
answered (a copy of this study may be found in Section A of 
this notebook). 

Reporting bias 

• Another type of bias that may arise is "reporting bias," which 

may result if cases and controls respond differently to 

2 

questions about personal smoking and ETS exposure. 

Publication bias 

• "Publication bias" arises from the apparent failure by 

scientific journals to publish papers reporting negative or 

weakly positive results. If this occurs, the set of published 

investigations may not be truly representative of all the 

3 

studies in the area. 

Confounding factors 

• The studies did not always account for possible confounding 
factors. (This is addressed in more detail in the section in 
this notebook on confounders.) 
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Use of questionnaires 


• All of the epidemiologic studies on the purported association 
between ETS exposure and disease in nonsmokers rely solely upon 
questionnaires about exposure, rather than upon actual exposure 
data. 4 Recent studies indicate that questionnaires are an 
unreliable and inaccurate measure of exposure. 

• Questionnaire responses about exposure vary widely when 
compared with actual measurements of ETS constituents in the 

5 

ambient air. 

Histology 

• Lung cancer diagnoses were not always histologically or 
pathologically verified. 1 

• Also, the histological composition, i.e., the type of lung 
cancer, differed among studies (in some studies, all 
histological types were included; in others, some types were 
excluded). 1 
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• Data-dredainci" 

• Investigators often examine numerous subgroups of the study 
population, and may report only those conclusions which fit 
with their hypothesis. 1 (This is sometimes called "data- 
dredging.") 

Misclassification 

• If the personal smoking status of subjects is not accurately 
classified, it could result in "misclassification bias." 

• One critic, Peter Lee, contends that the reported "risks" for 
nonsmokers are the result of bias caused by a small number of 
smokers who are reported in the studies as nonsmokers.^ 


Conclusion 


German scientist Karl Uberla discussed some criticisms of 
the ETS-lung cancer studies at a recent scientific symposium in 
Argentina: 


The majority of criteria for a causal connection 
are not fulfilled. There is no consistency, 
there is a weak association, there is no 
specificity, the dose-effect relation can be 
viewed controversially, bias and confounding 
are not adequately excluded, there is no 
intervention study, significance is only present 
under special conditions and the biological 
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following: 




b 


. 7 

plausibility can be judged controversially. 

The eminent statistician Nathan Mantel concluded the 


[I]t is unlikely that any epidemiological study 
has been, or can be, conducted which could 
permit establishing that the risk of lung cancer 
has been raised by passive smoking. Whether 
or not the risk is raised remains to be taken 
as a matter of faith. 


Copies of critical papers, highlighted in yellow for 
useful information and in blue for adverse statments, are found 

at Tabs 1-7. j 

| 
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CRITICISMS OF THE HIRAYAMA STUDY 


Numerous criticisms of the Hirayama study have been 
made. 8-21 They include: 

• The age distribution of the sample is not representative of the 
total Japanese population, particularly for women over the 
age of 40. 8 When a statistical correction is made for this 
bias, the increased relative risk reported by Hirayama 
virtually disappears. 

• The appropriateness of Hirayama's standardization of the data 
by husband's age, rather than by subject's, has been 
questioned. 9-12 When Kilpatrick re-analyzed the data adjusted 
by subject's age, the model used by Hirayama was shown to be 
inappropriate and the reported significantly elevated risk 
associated with husband's smoking was no longer apparent. 

• The Hirayama study was not designed to investigate ETS 

exposure; it is inappropriate to use it to make conclusions 

8 

about the hypothesis of an ETS-lung cancer relationship. 

• Errors and internal inconsistencies in the data and in risk 

ratios and confidence intervals have been noted and publicly 

. 13-15 

acknowledged by Hirayama. 
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use of 


• The design of the study has been criticized, e.g., 

Q 

death certificates as evidence for lung cancer is unreliable ; 
autopsy or histology results were available for only 11.5% 

o t r 

(23 of 200) of the cases '; use of the smoking status of 
the subject's husband as a surrogate measure for ETS exposure 
is not reliable 8 ' 12 ; many possible confounding factors were 
overlooked. 8 ' 17 

It appears that Hirayama has never adequately addressed 

the criticisms; for instance, his 1990 monograph on the study 

persists in presenting the same data analyses that have been 

particularly criticized. In addition, Hirayama has not made his 

8 19 20 

original data available for review. ' ' 

A bibliography of the criticisms follows. Copies of 
selected papers are given at Tabs 8-20. They are highlighted in 
yellow for useful information and in blue for adverse statements. 
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CRITICISMS OF THE TRICHOPOULOS STUDY 


Regarding the Trichopoulos, et al., study, the following 
criticisms have been made: 

• In 1990, Letzel and uberla evaluated the quality of ETS-lung 
cancer studies. Based on possible sources of bias and other 
problems with study design, they concluded that the 
Trichopoulos, et al. study, in particular, is "methodologically 
unacceptable" and is "a textbook example of how a case-control 
study should not be performed." Furthermore, they reported 
that this study may strongly influence the outcomes of meta- 
analyses of the ETS-lung cancer epidemiological studies (e.g., 
when the Trichopoulos study was included in meta-analyses of 
all possible case-control study combinations, it appeared in 
330 of the 353 significant study combinations). 

• Methodologically, the study has been criticized for selecting 

cases and controls from different hospitals; for excluding 

patients with adenocarcinoma and with alveolar carcinoma; 

for the lack of histological or cytological confirmation in 

8 24 

35% of the cases; and for its small sample size. ' According 

to uberla, the small sample size means that "the statistically 

‘significant’ results of this study may well be artefacts 

23 

from chance, bias or confounding." 
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Copies of the articles referenced above, highlighted in 
yellow for useful information and in blue for adverse statements 
are found at Tabs 21-23. 
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